CLAIM AMENDMENTS 



Claim Amendment Summary 
Claims pending 

• Before this Amendment: Claims 1-4, 6-9, 11-14, 16-28 and 30-36. 

• After this Amendment: Claims 1-4, 6-9, 11-14, 16-28 and 30-36. 
Non-Elected, Canceled, or Withdrawn claims: None. 

Amended claim: 23 
New claims: None 
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Claims: 



1. (Previously Presented) A method of managing annotations in a pen- 
based computing system, the method comprising: 

monitoring an electronic document for user annotations; 

recognizing entry of an annotation into the electronic document; 

collecting context data proximal to the annotation, wherein the context data 



time; 

location; and 

surrounding text; and 
determining whether the annotation comprises a gesture, wherein the gesture is an 
ink object commanding user defined functionality of a computer; 

determining whether the annotation is associated with a date; 
responsive to determining the annotation is associated with a date, determining if a 
date launch feature is enabled, such that: 

in an event no date launch feature is enabled, continuing monitoring the 
electronic document for user annotations; 

in an event the date launch feature is enabled, launching an associated 
application; 
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comprises: 




locating information related to the annotation using the annotation and the context 

data; 

wherein the collecting context data comprises: 
deriving at least two search terms; 

comparing the search terms to a history of search terms; and 

weighting each of the search terms according to whether a particular search 
term is included in the history of search terms, a higher weight being assigned to a 
search term that is included in the history of search terms; and 
wherein the locating information related to the annotation comprises: 

determining keywords that are likely to be of interest to a user based on the 
annotation and words contained in documents previously accessed by the user; and 

using the keywords to locate information such that: 

in an event a user-specified domain is selected, the keywords are 

used to locate information in one of a plurality of user-specified domains 

comprising: 

a local computer; 

a local network drive; and 

the Internet. 



2. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises extracting one or more words from text proximal to the 



annotation. 
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3. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises locating objects near to an annotation object in a document 
object model (DOM) associated with the annotation. 



4. (Original) The method as recited in claim 1, wherein the collecting 
context data further comprises: 

defining a first distance from the annotation; 
defining a second distance from the annotation; 

locating one or more keywords that are within the first distance from the 
annotation; 

locating one or more keywords that are within the second distance from the 
annotation but not within the first distance from the annotation; 

weighting the one or more keywords according to their distance from the 
annotation, with keywords within the first distance having a greater weight than 
keywords within the second distance but not within the first distance; and 

wherein the locating information related to the annotation utilizes the keywords 
according to the weights assigned thereto. 

5. (Canceled) 
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6. (Previously Presented) The method as recited in claim 1 , wherein the 
history of search terms comprises a history of search terms used by a particular user. 

7. (Previously Presented) The method as recited in claim 1, wherein the 
history of search terms comprises a history of search terms used by all users of a 
particular group of users. 

8. (Original) The method as recited in claim 1, wherein the locating 
information related to the annotation further comprises searching the electronic document 
for terms that match or are similar to the annotation. 

9. (Original) The method as recited in claim 1, wherein the locating 
information related to the annotation further comprises searching remote sites for 
documents containing terms that match or are similar to the annotation. 

10. (Canceled) 

11. (Previously Presented) The method as recited in claim 1, wherein the 
documents that were previously accessed by the user are limited to documents accessed 
within a specified time period. 
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12. (Previously Presented) The method as recited in claim 1, wherein the 
determining keywords that are likely to be of interest to a user based on the annotation 
and words contained in documents previously accessed by the user comprises: 

determining keywords that are likely to be of interest to the user based on the 
annotation and words occurring with the annotations in the documents that were 
previously accessed by the user. 

13. (Previously Presented) The method as recited in claim 1, wherein 
annotations are recognized from a plurality of types of annotations, the plurality of types 
of annotations comprising: 

circle; 

underline; 

block; 

arrow; 

callout; 

free note; and 

post-it note. 
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14. (Previously Presented) An annotation management system, comprising: 
a processor; 

a system memory coupled to the processor, the system memory comprising: 

a feature database configured to store a gesture comprising an ink object 
commanding user defined functionality of the system; 

an annotation monitoring module configured to monitor an electronic 
document for entry of an annotation; 

the annotation monitoring module further configured to recognize entry of 
an annotation into the electronic document; 

an extraction module configured to perform acts comprising: 

collecting context data that appears proximal to the annotation , 

wherein the context data comprises: 
time; 

location; and 

surrounding text; and 
determining whether the annotation comprises a gesture, wherein the 
gesture is an ink object commanding user defined functionality of a 
computer; 

determining whether the annotation is associated with a date; 
responsive to determining the annotation is associated with a date, 
determining if a date launch feature is enabled, such that: 
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in an event no date launch feature is enabled, continuing 
monitoring the electronic document for user annotations; 

in an event the date launch feature is enabled, launching an 
associated application; 
a query modification module configured to locate information related to the 
annotation using the annotation and the context data; 

the extraction module further configured such that collecting context data 
comprises: 

deriving at least two search terms; 

comparing the search terms to a history of search terms; and 
weighting each of the search terms according to whether a particular 
search term is included in the history of search terms, a higher 
weight being assigned to a search term that is included in the history 
of search terms; and 
an information processing module configured to locate information related 

to the annotation, wherein the locating information related to the annotation 

comprises: 

determining keywords that are likely to be of interest to a user based 
on the annotation and words contained in documents previously accessed 
by the user; and 

using the keywords to locate information such that: 
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in an event a user-specified domain is selected, the keywords 
are used to locate information in one of a plurality of user-specified 
domains comprising: 

a local computer; 

a local network drive; and 

the Internet. 



15. (Canceled) 



16. (Previously Presented) The system as recited in claim 14, wherein: 
the context data comprises a plurality of keywords derived from text proximal to 
the annotation; 

the extraction module is further configured to weight each keyword according to a 
relative distance that the keyword is from the annotation; and 

the information processing module is further configured to locate the related 
content based on the weighted keywords as weighted according to the relative distance 
that each keyword is from the annotation. 



17. (Previously Presented) The system as recited in claim 16, wherein a 
search is performed using the annotation as a search term and the results of the search are 
re-ranked according to the weighted keywords as weighted according to the relative 
distance that each keyword is from the annotation. 
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18. (Previously Presented) The system as recited in claim 16, wherein a 
search is performed using a query derived from the annotation and the weighted 
keywords as weighted according to the relative distance that each keyword is from the 
annotation. 

19. (Previously Presented) The system as recited in claim 14, wherein the 
related content located by the information processing module comprises keywords 
contained in the electronic document. 

20. (Previously Presented) The system as recited in claim 14, wherein the 
related content located by the information processing module comprises documents on a 
network that contain one or more of the keywords. 

21. (Previously Presented) The system as recited in claim 14, wherein the 
information processing module is further configured to determine suggested keywords 
that are likely to be of interest to the user based on the annotation and words appearing in 
other documents previously accessed by the user in which the same annotation was 
entered. 
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22. (Original) The system as recited in claim 21, further comprising a user 
interface configured to present the suggested keywords to the user and provide for 
selection of none or one or more of the suggested keywords by the user. 



23. (Currently Amended) One or more computer-readable media 
comprising non-volatile storage, the computer-readable media having computer- 
executable instructions embodied thereon on at l e ast on e tangibl e compon e nt of th e 
computer readable media , the computer-executable instructions when the computer- 
readable media is operably coupled to a processor being executed on a computer to 
program , cause the computer to perform steps comprising: 

monitoring an electronic document for user annotations; 

recognizing an annotation entered into the electronic document ; 

collecting context data proximal to the annotation, wherein the context data 
comprises: 

time; 

location; and 
surrounding text; and 
determining whether the annotation comprises a gesture, wherein the gesture is an 
ink object commanding user defined functionality of a computer; 

determining whether the annotation is associated with a date; 
responsive to determining the annotation is associated with a date, determining if a 
date launch feature is enabled, such that: 
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in an event no date launch feature is enabled, monitoring the electronic 
document for user annotations; 

in an event the date launch feature is enabled, launching an associated 
application; 

locating information related to the annotation using the annotation and the context 

data; 

wherein the collecting context data comprises: 
deriving at least two search terms; 

comparing the search terms to a history of search terms; and 

weighting each of the search terms according to whether a particular search 
term is included in the history of search terms, a higher weight being assigned to a 
search term that is included in the history of search terms; and 
wherein the locating information related to the annotation comprises: 

determining keywords that are likely to be of interest to a user based on the 
annotation and words contained in documents previously accessed by the user; and 

using the keywords to locate information such that: 

in an event a user-specified domain is selected, the keywords are 

used to locate information in one of a plurality of user-specified domains 

comprising: 

a local computer; 

a local network drive; and 

the Internet. 
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24. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein annotations are recognized from a plurality of types of 
annotations, the plurality of types of annotations comprising: 

a circle; 

a box; 

an arrow; 

an underline; 

a double underline; 

a bracket; 

a highlight; 

a handwritten character; 
a free note; 
a post-it note. 

25. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the collecting context data related to the location of the 
annotation comprises collecting objects occurring within a certain distance from an 
annotation object in a document object model associated with the annotation object. 
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26. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises locating one or 
more local keywords in the electronic document. 

27. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises locating one or 
more documents on a network that include one or more words indicated by the annotation 
or one or more keywords derived from the context data or from the documents that were 
previously accessed by the user. 

28. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the locating additional content comprises deriving the one or 
more keywords from the context data by identifying words that frequently appear with 
the annotation in other documents accessed by the user. 

29. (Canceled) 

30. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the steps further comprise: 

ranking search results according to the weighted search terms. 
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31. (Previously Presented) The one or more computer-readable media as 
recited in claim 30, wherein the previously-used keywords were previously used by a 
current user, and wherein the weighting of at least a portion of the search terms comprises 
assigning a higher weight to search terms that are included in the keyword history list for 
the current user. 



32. (Previously Presented) The one or more computer-readable media as 
recited in claim 30, wherein the previously-used keywords were previously used by all 
users in a group of users, and wherein the weighting of at least a portion of the search 
terms comprises assigning a higher weight to search terms that are included in the 
keyword history list for the group of users. 



33. (Previously Presented) The method as recited in claim 1 , further 
comprising: 

detecting user input comprising a gesture associated with a search task; 
wherein the locating information related to the annotation using the annotation and 
the context data is performed responsive to the detecting. 



34. (Previously Presented) The method as recited in claim 33, further 
comprising: 

assigning, by the user, the search task to the gesture so as to associate the gesture 
with the search task. 
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35. (Previously Presented) The system as recited in claim 14, wherein the 
information processing module is further configured to perform a search to locate the 
related content responsive to when the annotation monitoring module detects user input 
of a gesture that is associated with a search task. 

36. (Previously Presented) The one or more computer-readable media as 
recited in claim 23, wherein the steps further comprise: 

detecting user input of a gesture that is associated with a search task; 
wherein the locating additional content that may be of interest to the user by 
executing a search is performed responsive to the detecting. 
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